AMENDMENT AND RESPONSE UNDER 37 CFR § 1.116 - EXPEDITED PROCEDURE 

Serial Number: 10/609,000 
Filing Date: June 26, 2003 

Title: Video combiner 

IN THE CLAIMS 

Please amend the claims in the patent application as follows wherein newly added text is 
indicated with underlining and deleted text is marked with strikethrough or enclosed within 
[[double brackets]]: 

1 . (Currently Amended) A method of producing a video signal at a set top 
box used for outputting video programming to at least one viewer, said method comprising: 
receiving a first video signal at said set top box; 

processing said first video signal to produce a first image stored in memory of said set top 

box , said first image not intended to be displayed independently : 
receiving a second video signal at said set top box; 

processing said second video signal to produce a second image stored in said memory of 
said set top box , said second image not intended to be displayed independently : 

accessing a presentation description comprising a set of instructions that define d e fines a 
portion of said first image and that defines the manner in which said portion of said 
first image and a portion of said second image are combined, the manner in which the 
images are combined being selected from at least one of a plurality of manners of 
combinations, and the presentation description instructions also defining including a 
sequence of operations performed over time being select e d from at least one of a 
plurality of sequences ; 

combining said portion of said first image with said portion of second image in 
accordance with said presentation description to produce a combined image; and 

outputting displaying said combined image as said video signal as part of said video 
programming to said at least one viewer . 
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2. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of combining further comprises: 

applying a mask that defines said portion of said first image. 
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3. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of combining said vid e o signals further comprises: 

generating a logical combination of said portion of said first image and said portion of 
said second image. 

4. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of combining said vid e o signals further comprises: 

generating a mathematical combination of said portion of said first image and said 
portion of said second image. 

5. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of combining said vid e o signals further comprises: 

scaling said portion of said first image. 

6. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of combining said video signals further comprises: 

warping said portion of said first image. 

7. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of accessing said presentation description further comprises: 

fetching accessing said presentation description across a network. 

8. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of accessing said presentation description further comprises: 

receiving a network address at which said [[a]] presentation description can be accessed; 
fetching said presentation description from said network address . 
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9. (Currently Amended) The method as set forth in [[of]] claim 1 wherein 
said step of accessing said presentation description further comprises: 

selecting said presentation description from a plurality of presentation descriptions 
contained in said first video signal. 

1 0. (Currently Amended) The method as set forth in [[of]] claim 1 , said 
method further comprising: 

modifying said presentation description in response to a user input from said at least one 
viewer . 



1 1 . (Currently Amended) The method as set forth in [[of]] claim 1 , said 
method further comprising: 

processing said first video signal to produce first audio data stored in said memory of said 
set top box; 

processing said second video signal to produce second audio data stored in said memory 
of said set top box; 

accessing said [[a]] presentation description that describes the manner in which said first 

audio data and said second audio data are combined; and 
combining said first audio data and said second audio data in accordance with said 

presentation description. 

12. (Currently Amended) A method of producing displaying a sequence of 
combined images in a set top box used for outputting video programming to said at least one 
viewer, said method comprising: 

receiving a first video signal at said set top box; 

processing said first video signal to produce a first sequence of images stored in memory 
of said set top box , said first sequence of images not intended to be displayed 
independently ; 

receiving a second video signal at said set top box; 
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processing said second video signal to produce a second sequence of images stored in 
said memory of said set top box , said second sequence of images not intended to be 
displayed independently ; 

accessing a presentation description comprising a set of instructions that define d e fin e s a 
portion of said first sequence of images and that defines the manner in which said 
portion of said first sequence of images and a portion of said second sequence of 
images are combined, the manner in which the sequences of images are combined 
being selected from at least one of a plurality of manners of combinations, and the 
presentation description instructions also defining including a sequence of operations 
performed over time being s e l e cted from at l e ast one of a plurality of s e qu e nces ; 

combining said portion of said first sequence of images with said portion of said second 
sequence of images in accordance with said presentation description to produce a 
finalized sequence of combined images; and 

outputting displaying said finalized sequence of combined images as a part of said video 
programming to said at least one viewer . 

13. (Currently Amended) The method as set forth in [[of]] claim 12 wherein 
said step of combining further comprises: 

applying a mask specified in said presentation description that defines said portion of said 
first sequence of images. 

14. (Currently Amended) The method as set forth in [[of]] claim 13 wherein 
said step of applying a mask further comprises: 

executing program code that modifies said mask to select a different portion of at least 
one image of said first sequence of images. 

15. (Currently Amended) The method as set forth in [[of]] claim 12 wherein 
said step of combining said video signals further comprises: 

generating a mathematical combination of said portion of one image of said first 

sequence of images and said portion of one image of said second sequence of images. 
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16. (Currently Amended) The method as set forth in [[of]] claim 12 wherein 
said step of combining said video signals further comprises: 

generating a logical combination of said portion of one image of said first sequence of 
images and said portion of one image of said second sequence of images. 

17. (Currently Amended) The method as set forth in [[of]] claim 12 wherein 
said step of combining said video signals further comprises: 

scaling said portion of one image of said first sequence of images. 

18. (Currently Amended) The method as set forth in [[of]] claim 12 wherein 
said step of combining said video signals further comprises: 

warping said portion of one image of said first sequence of images. 

19. (Currently Amended) The method as set forth in [[of]] claim 12 , said 
method further comprising: 

modifying said presentation description in response to a user input from said at least one 
viewer . 

20. (Currently Amended) A method of controlling generation of a combined 
video signal for use as video programming to at least one viewer in a set top box unit at said at 
least one viewer's a user's premises from a broadcast site , said method comprising: 

transmitting a first digital video signal to said set top box , said first digital video signal 
comprising a first image not intended to be displayed independently : 

transmitting a second digital video signal to said set top box substantially simultaneously 
with said first digital video signal , said second digital video signal comprising a 
second image not intended to be displayed independently ; 

loading image combination code into said set top box; and 

providing a presentation description to said set top box , said presentation description 
comprising a set of instructions that define describes the manner in which a portion of 
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[[an]] said first image contained in said first digital video signal is combined with a 
portion of [[an]] said second image contained in said second digital video signal to 
produce said combined video signal for use as video programming to at least one 
viewer the manner in which the images are combined being selected from at least one 
of a plurality of manners of combinations, and the presentation description 
instructions also defining including a sequence of operations performed over time 
b e ing s e l e ct e d from at least one of a plurality of s e quenc e s . 

21 . (Currently Amended) The method as set forth in [[of]] claim 20 wherein 
said step of providing a presentation description further comprises: 

transmitting a network address that said set top box employs to access said presentation 



22. (Currently Amended) The method as set forth in [[of]] claim 20 wherein 
said step of providing a presentation description further comprises: 

transmitting said presentation description to said set top box as a part of said first digital 
video signal. 

23 . (Currently Amended) The method as set forth in [[of]] claim 20 wherein 
said step of providing a presentation description further comprises: 

selecting said presentation description from a plurality of presentation descriptions 
wherein said presentation description conforms to the requirements of said set top 
box. 

24. (Currently Amended) The method as set forth in [[of]] claim 20 wherein 
said step of providing a presentation description further comprises: 

altering a general presentation description to conform to the requirements of said set top 
box. 
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25. (Currently Amended) The method as set forth in [[of]] claim 20 wherein 
said step of providing a presentation description further comprises: 

tailoring a general presentation description to correspond to a viewer preference. 

26. (Currently Amended) The method as set forth in [[of]] claim 20 wherein 
said step of providing a presentation description further comprises: 

transmitting a plurality of presentation descriptions to said set top box from which said 
set top box selects one presentation description that conforms to the requirements of 
said set top box. 

27. (Currently Amended) A set top box system that produces a combined 
video signal for use as video programming to at least one viewer, said system comprising: 

a processor; 

a memor y, said memory coupled to said processor : 

a tuner/decoder that receives a first video signal and a second video signal substantially 
simultaneously and that routes control information contained in said first video signal 
to said processor and that routes first video data from said first video signal and 
second video data from said second video signal to a video decoder; 

said video decoder that decodes said first video data and produces a first video image in 
said memory and that decodes said second video data and produces a second video 
image in said memory , said first video image and said second video image not 
intended to be displayed independently ; 

a presentation description stored in said memory , said presentation description 

comprising a set of instructions that define specifies the manner in which a portion of 
said first video image is combined with a portion of said second video image to 
produce said combined video signal, the manner in which the images are combined 
being selected from at least one of a plurality of manners of combinations, and the 
presentation description instructions also defining including a sequence of operations 
performed over time being sel e cted from at least on e of a plurality of sequ e nces ; 
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program code operating in said processor that employs said presentation description and 
that accesses said portion of said first video image and said portion of said second 
video image in said memory and that combines said first portion of said first video 
image and said portion of said second video image in the [[a]] manner specified by 
said presentation description to create said combined video signal ; and 

a video output unit that outputs said combined video signal to a display device as a part 
said video programming to said at least one viewer . 

28. (Currently Amended) The system as set forth in [[of]] claim 27 , said 
system further comprising: 

a network interface that accesses a remote server to obtain said presentation description. 

29. (Currently Amended) The system as set forth in [[of]] claim 27 wherein 
said decoder further produces first audio data in said memory from said first video information 
and produces second audio data in said memory from said second video information. 

30. (Currently Amended) The system as set forth in [[of]] claim 29 wherein 
said presentation description further specifies the manner in which said first audio data is 
combined with said second audio data. 

3 1 . (Currently Amended) The system as set forth in [[of]] claim 27 , said 
system further comprising: 

a user interface that receives an input from said at least one viewer a user that modifies 
said presentation description. 

32. (Currently Amended) The system as set forth in [[of]] claim 27 , said 
system further comprising: 

viewer user preference information from said at least one viewer stored in said memory 
that is used by said presentation description. 
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33. (Currently Amended) The system as set forth in [[of]] claim 27 wherein 
said program code operating in said processor further comprises: 

a software routine that controls said decoder to perform at least part of the combination of 
said portion of said first video image and said portion of said second video image in a 
manner specified by said presentation description. 

34. (Currently Amended) The system as set forth in [[of]] claim 27 wherein 
said program code operating in said processor further comprises: 

a software routine that selects said presentation from a plurality of presentation 
descriptions contained in said first video signal. 

35. (Currently Amended) A set top box that produces a combined video signal 
for use as video programming, said set top box comprising: 

processor means that processes process a presentation description and that control th e 

mann e r in which imag e s ar e combined ; 
memory means that store software executable by said processor means and that store 

video images; 

tuner/decoder means that receive a first video signal and a second video signal and that 
route control information contained in said first video signal to said processor means 
and that route first video information from said first video signal and second video 
information from said second video signal to decoder means; 

decoder means that decode said first video information and produce a first video image in 
said memory means and that decode said second video information and produce a 
second video image in said memory means , said first video image and said second 
video image not intended to be displayed independently ; 

presentation description means , said presentation description means comprising a set of 
instructions that specify the manner in which a portion of said first video image is 
combined with a portion of said second video image to produce a combined image, 
the manner in which the images are combined being selected from at least one of a 
plurality of manners of combinations, and the instructions pres e ntation description 
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also defining including a sequence of operations performed over time being sel e ct e d 
from at l e ast one of a plurality of sequenc e s ; and 
video output means that output said combined image as said combined video signal to a 
display device as a part of said video programming to said at least one viewer . 



